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BACKGROUND OF THE INVENTION 



7. Field of the Invention 



The invention relates to a delta caching service, and related methods and systems. 



2 Related Art 



In a system that delivers information jfrom a server to clients who request that in- 
formation (such as a web server delivering information to a set of web clients), it is desirable to 
minimize the amount of data that is actually sent from the web server to the web client. Delta 
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1 caching is a technique by which the server and the client differentiate between template informa- 

2 tion and delta infonnation for an object to be delivered from the server to the client; the client 

3 maintains a copy of the template information and the serv^ is tiierefore able to deliver the object 

4 by only sending the delta information. 

5 

6 The web server often manages relatively large loads by dividing its tasks, using a 

7 load balancer, among a set of server-responders. However, differing server-responders might 

8 then associate different template information with objects at the server. One consequence is that 

9 when a client communicates with more than one server-responder, the template information 
'^"^lO known to the client and to the server-responder might differ. This is increasingly more likely as 
■^^1 1 the number of server-responders is increased, and might result in miscommunication between a 

as n 

I gl2 client and one or more of the server-responders. 

014 SUMMARY OF THE INVENTION 

fUl5 

fU 

pi 6 The invention provides a method and system capable of ensuring that each client 

17 can consistently communicate with, one or more servers using delta caching. Building templates 

18 for objects at the server(s) is functionally separated from encoding objects for delivery to clients. 

19 One or more template-builders are logically separated from one or more delta-encoders. Each 

20 operates independently to perform its part of delta caching; template-builders build templates, 

21 while delta-encoders use those templates to encode objects for delta caching. 

22 
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1 In an aspect of the invention, template-builders also operate so that those clients 

2 not configured for explicit delta caching can perform implicit ("clientless") delta caching by ref- 

3 erence to templates maintained at one or more template-builders. In an aspect of the invention, 

4 delta-encoders also opiate so that the template information and the delta information for any ob- 

5 ject can be separately compressed or sent to clients. In one embodiment, delta-encoders operate 

6 with template-builders using a client-server technique. 
7 

8 BRIEF DESCRIPTION OF THE DRAWINGS 
9 

i^^lO Figure 1 shows a block diagram of a system including a delta caching service. 

o 

Qn 

w 

fU 

'^12 Figure 2 shows a process flow diagram of a method including a delta caching ser- 

?:^13 vice. 

'5 CP 

im INCORPORATED DISCLOSURES 

m 

17 Inventions described herein can be used in conjunction with technology described 

18 in the following docimients: 
19 

20 • U.S. Patent Application Serial No. 09/734,910, (Express Mail Mailing No. EL 768 961 

21 028US), filed December 11, 2000, in the name of Stephane KASRIEL, attorney docket num- 

22 ber 1 55. 1 002.01 , titled "Predictive Pre-download Using Normalized Network Object Identi- 

23 fiers", and applications claiming priority therefrom. 
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1 • US Patent Application Serial No. 60/263,247, (Express Mail Mailing No. EK 913558282US^ 

2 filed January 22, 2001 , in the name of Stephane KASRIEL, attorney docket number 

3 155.1003.01, titled "Server Driven Differential Caching", and applications claiming priority 

4 therejfrom. 
5 

6 • U.S. Patent Application Serial No. 10/058,232, (Express Mail Mailing No. EL 734 815 560 

7 US), filed October 19, 2001, in the name of Stephane KASRIEL, attomey docket number 

8 155.1008.01, titled "Differential Caching with Many-to-One and One-to-Many Mapping", 

9 and applications claiming priority therefrom. 



bo 



il « 



If). 1 These documents are hereby incorporated by reference as if fully set forth herein, 

:12 and are sometimes referred to herein as the "incorporated disclosures". 

i 

,#3 



55 



Ca4 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Ilks 



irl6 In the description herein, a preferred embodiment of the invention is described, 

17 including preferred process steps and data structures. Those skilled in the art would realize, after 

18 perusal of this application, that embodiments of the invention might be implemented using a va- 

19 riety of other techniques not specifically described, without undue experimentation or further in- 

20 vention, and that such other techniques would be within the scope and spirit of the invention. 
21 

22 
23 
24 
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Lexicography 

The following terms relate or refer to aspects of the invention or its embodiments. 
The general meaning of each of these terms is intended to be illustrative and in no way limiting. 

• client, server — In general, these terms refer to devices or software elements operating 
in a client/server relationship. 

There is no particular requirement that any particular client or any particular server must 
be a single hardware device or software module. For example, in some embodiments, the 
client device or the server device might include multiple devices operating cooperatively 
(such as when networked) or might include a portion of one or more devices. 

In one embodiment, the client includes a personal computer, such as a workstation, a lap- 
top, or a handheld computer, having a web browser disposed for requesting web objects 
fi-om the server. In the same embodiment, the server includes one or more web servers, 
possibly coupled to a network using an element for distributing requests, each of which is 
disposed for parsing requests for web objects, and for providing those web objects in re- 
sponse thereto. The web objects might be deemed "static," in which case they are re- 
trieved from a file system, a database, or other storage, or might be deemed "dynamic," 
in which case they are at least partially generated by the web server in response to infor- 
mation that is possibly time- varying. 
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1 There is no particular requirement that any particular client or any particular server must 

2 be a single hardware device or software module. For example, in some embodiments, the 

3 client device or the server device might include multiple devices operating cooperatively 

4 (such as when networked) or might include a portion of one or more devices. 

5 

6 • delta caching — In general, this refers to a technique in which a client obtains informa- 

7 tion regarding a web object in at least two parts: "template information," which refers to 

8 information that might be relatively static and is (in one embodiment) retained at the cli- 

9 ent, and "delta information," which refers to changes from the template information and 
>*10 is (in one embodiment) provided by the server in response to a difference between a pre- 

9 

\%l 1 sent value of the web object and the template information. 

fit 

yl3 • delta encoder — In general, this refers to an element that computes the delta informa- 

QH tion, such as a difference between a present value of the web object and the template in- 

f ylS formation. In one embodiment, the delta encoder might compress the delta information 

6 for delivery to the client. 

! 

17 

18 • delta information — In general, this refers to information to be added to the template in- 

19 formation to compose an entire web object. 
20 

21 • encoding web object for delivery — In general, this refers to a technique in which tem- 

22 plate information is identified for the web object, delta information is computed in re- 



•i«H3 
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1 sponse to the web object and the template information, and the delta information is for- 

2 matted (such as in an HTTP response message) for delivery to a requesting client. 
3 

4 • implicit ("clientless") delta caching — In general, this refers to a delta caching tech- 

5 nique in which delta information is formatted for delivery to a requesting client, and in 

6 which the formatted delta information includes program fragments (such as JavaScript) 

7 stimulating the client to retrieve the template information if that template information is 

8 not already at the client. 
9 

NiO • template, template information — In general, this refers to information which is rela- 

1 1 1 tively static, or information that has not changed since the last request for the same web 



CO 



1 12 object, or information retained by the client. 



IS 



514 • template builder — In general, this refers to an element that computes the template in- 

fU 

m 15 formation, such as in response to a change in a web object. 

ry 

Ol6 

Bar. 

17 • web page, web object — In general, this refers to an object available at (or dynamically 

18 computed at) the server. A web object might include text, pictures, graphics, animation, 

19 video or other motion pictures, sound, program fragments or scripts, or other data. When 

20 a web object is associated with a specific URL and is intended for presentation by the cli- 

21 ent, it might be referred to as a web page. 
22 
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1 The scope and spirit of the invention is not limited to any of these definitions, or 

2 to specific examples mentioned therein, but is intended to include the most general concepts em- 

3 bodied by these and other terms. 

4 System Elements 
5 

6 Figure 1 shows a block diagram of a system including a delta caching service. 
7 

8 A system 100 includes a chent 1 10, a communication network 120, a server 130, 

9 a delta encoder 1 40, and a template builder 1 50. 

Ml Client 



iyl3 The client 110 includes a workstation having a processor, program and data 

r^4 memory, and mass storage, and is operated by at least one user 111. In one embodiment, the 

ryL5 program includes a web browser, disposed for requesting web objects from the server 130, for 

fy 

C3l6 receiving web objects from the server 130, and for presenting web objects to the user 111. The 

rU 

17 program and data memory and mass storage collectively include a client cache 1 12, in which the 

18 client 1 1 0 records information from the server 1 30 for presentation to the user 111. 
19 

20 The client 1 10 is coupled to the communication network 120, and is disposed for 

21 sending request messages 1 13 to the server 130. In one embodiment, the request messages 113 

22 are formatted in a known protocol, such as HTTP (hypertext transfer protocol), SHTTP (secure 
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1 HTTP), FTP (file transfer protocol), or a variant thereof. The chent 110 is also disposed for re- 

2 ceiving messages from other elements in the system 100. 
3 

4 Network 
5 

6 The network 120 includes a communication link capable of delivering informa- 

7 tion between the client 1 10 and other elements in the system 100. In one embodiment, the com- 

8 munication network 120 includes an internet. However, in altemative embodiments, the network 

9 120 may include an intranet, a LAN or WAN, a portion of a ATM network or PSTN or other 
10 switching network, or in general any elements disposed for delivery of information. 



f|Jl5 vice 131 includes a processor, program and data memory, and mass storage. Each web server 
Oi6 device 131 is disposed for receiving request messages 1 13, for retrieving (or dynamically gener- 



17 ating) one or more web objects 132 in response thereto, and for formatting a response message 

18 133 including those web objects 132. 
19 



21 the web server devices 131. The load balancer 134 includes a processor, and program and data 

22 memory, and is disposed for receiving request messages 113 and for delivering those request 

23 messages 1 13 to individual web server devices 131. This has the effect of distributing the work- 




Server 




The server 130 includes at least one web server device 131. Each web server de- 



20 



In one embodiment, the server 130 includes a load balancer 134 and a plurality of 
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1 load of responding to request messages 1 13 across more than one web server device 131, so the 



2 server 1 30 can respond with relatively less latency to individual request messages 113. 



3 



4 The web objects 132 might be retrieved from the mass storage, in which case they 



5 are deemed "static," or might be dynamically generated by the server 130 (specifically, by one of 



6 the web server devices 1 3 1 ) in response to information that might possibly be time-varying. For 



7 example, if the web object 132 specified by one of the request messages 113 includes stock 



8 quote information, the server 130 would dynamically generate that web object 132 in response to 



9 actual stock quotes (such as retrieved from a separate stock quote server). 



Hio 

On Delta Encoder 

ffk 

^13 The delta encoder 140 includes a processor, program and data memory, and mass 

H H storage, collectively including a request interceptor 141, a request forwarder 142, an object com- 

lU 

15 parator 143, and a delta formatter 144. 

iiy 
fU 

17 The request interceptor 141 is coupled to the network 120, and is disposed for in- 



1 8 tercepting request messages 113 that are destined for the server 1 30. 



19 

20 The request forwarder 142 is coupled to the network 120 and to the request inter- 

21 ceptor 141, and is disposed for forwarding the intercepted request messages 113 to the server 

22 130. 

23 
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1 In alternative embodiments, the server 130 might be disposed for sending all re- 

2 sponse messages 133 to the delta encoder 140, in which case the request interceptor 141 and the 

3 request forwarder 142 would not be needed. Accordingly, these elements might be regarded as 

4 optional. 
5 

6 The object comparator 143 is coupled to the network 120, and is disposed for re- 

7 ceiving response messages 133 from the server 130. The object comparator 143 compares web 

8 objects 132 found in those response messages 133, using a set of template information 157 from 

9 the template builder 1 50, and generates delta information 1 56. 

0 

!f 1 1 In one embodiment, the delta encoder 140, from time to time, sends a request to 

'|12 the template builder 150 for the template information 157, and records that template information 

[yl3 1 57 in its memory or mass storage. The delta encoder 140 would therefore have the template in- 

|jl4 formation 157 readily available for computing the delta information 156. In altemative embodi- 

fy 

fyi5 meats, the delta encoder 140 sends a request to the template builder 150 for the template infor- 

ry 

Ol6 mation 157 in response to need for that information by the object comparator 143, and uses the 

m 

17 template information 157 relatively immediately. The delta encoder 140 would therefore have 

18 no special requirement for recording that template information 157 in its memory or mass stor- 

19 age. 
20 

21 The delta formatter 144 is coupled to the network 120 and to the object compara- 

22 tor 143, and is disposed for formatting the delta information 156 for delivery to the client 110. 
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1 The delta formatter 144 generates a response message 133 and sends that response message 133 

2 to the network 1 20 for delivery to the client 1 1 0. 

3 

4 In one embodiment, the delta formatter 144 compresses the delta information 156 

5 before packaging that information in the response message 1 33. 
6 

7 Template Builder 
8 

9 The template builder 150 includes a processor, program and data memory, and 

1^10 mass storage, collectively including an object requestor 151, a template identifier 152, and a 

:i 1 1 template server 1 53. 

=^12 

^^13 The object requestor 151 operates, from time to time, to request web objects 132 

014 from the server 130. The template builder 150 receives the web objects 132 and records them in 

fU 15 its memory or mass storage. 

lU 

W16 



17 The template identifier 152 operates, from time to time, on web objects 132 re- 

18 corded in memory or mass storage, and generates template information 157. In one embodiment, 

19 the template information 157 can be compressed by the template builder 150 for delivery to the 

20 delta encoder 140 or to the client 1 10. 

21 

22 The template server 153 operates in like manner as the server 130, in that it re- 

23 ceives request messages 113 and sends response messages 133. However, the template server 
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1 153 provides template information 157 instead of web objects 132 in response to the request 

2 messages 113. 

3 

4 The template server 153 is available for responding to requests by the delta en- 

5 coder 140, so the delta encoder 140 can obtain template information with which to compute delta 

6 information 156. 
7 

8 In alternative embodiments, the delta encoder 140 can operate to format the delta 

9 information 156 using program fragments such as JavaScript, as described in the incorporated 

HlO disclosures. In this mode of operation, the client 110 does not need to know that the delta infbr- 

p 

§1 1 mation 156 does not include the entire web object 132. Rather, when the client 110 attempts to 

' pl2 present the web object 132 (it has only the delta information 156), the program fragments direct 

?j1l3 it to request and receive template information 157 frxm the template server 153, in like manner 

ril4 as it would request and receive a web object 132 from the server 130. Accordingly, the cHent 

fUl5 110 can obtain both the delta information 156 and the template information 157, and it can pre- 

•AS S 

%3l6 sent the entire web object 132. 

m 

17 

18 Method of Operation 
19 

20 Figure 2 shows a process flow diagram of a method including a delta caching ser- 

21 vice. 

22 
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1 A method 200 is perfonned by the system 100. Although the method 200 is de- 

2 scribed serially, the flow points and steps of the method 200 can be perfonned by separate ele- 

3 ments in conjunction or in parallel, whether asynchronously or synchronously, in a pipelined 

4 manner, or otherwise. There is no particular requirement that the method 200 must be performed 

5 in the same order in which this description Usts flow points or steps, except where expUdtly so 

6 indicated. 
7 

8 Ghent 
9 

MO At a flow point 210, the cUent 1 10 is ready to request a web object 132 from the 

o 

f3l 1 server 130. 

ryi2 

3 At a step 2 1 1 , the client 1 1 0 sends a request message 1 1 3 to the server 1 30. 

At a step 212, the client 110 receives a response message 133 from the delta en- 

p6 coder 140, including delta information 156. In one embodiment, the chent 110 recognizes the 

17 response message 133 as including only delta information 156, and the client 110 knows it must 

18 combine the delta information 156 with template information 157 to present the entire web ob- 

19 ject 132. In alternative embodiments such as "clientless'' delta caching, the response message 

20 133 includes at least one program fragment directing the chent 1 10 to obtain the template infor- 

21 mation 157 (either from its client cache 1 1 1 or from the template server 153). 
22 



EL 734815180US 



14 



155.1010.01 

1 At a step 213, the client 1 10 determines if it has the requisite template information 

2 157 to present the entire web object 132. If not, the client 110 proceeds with the step 214. If so, 

3 the client 1 10 proceeds with the step 215. 
4 

5 At a step 214, the client 1 10 requests the requisite template information 1 57 from 

6 the template server 1 53 or the delta encoder 140. Template mformation 1 57 can be served from 

7 both the template server 153 or the delta encoder 140 because they both include the template. A 

8 cHent 1 10 can be instructed to get the template information 157 from either source. Serving the 

9 template infonnation 157 from the template server 1 53 is particularly advantageous in configura- 

K 10 tions in which the server 130 is not associated with a delta encoder 140. 

C3 

C-S ^1 

% 12 hi other embodiments, a CDN (content delivery network) can be used to serve 

B 13 templates information 157. Thus, there are four possibilities: 1) the template builder 150 serves 

Q 14 template information 157 directly to the cHent 1 10, (2) the delta encoder 140 serves template in- 

m 

• W 15 formation 157 directly to the client 1 10, (3) the template builder 150 serves template information 

|| 16 157 to the client through a CDN and (4) the template builder 150 serves template information 

17 1 57 to the chent 1 1 0 through a CDN and the delta encoder 140 serves content to a CDN, which 

1 8 serves it to the client 110 
19 

20 At a step 2 1 5, the client 1 1 0 combines the delta information 1 56 with template in- 

21 formation 1 57 to present the entire web object 1 32. 

22 

23 The client 1 1 0 returns to the flow point 210. 
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1 Server 
2 

3 The server 1 30 operates in like manner as an ordinary web server. 

4 

5 Delta Encoder 
6 

7 At a flow point 220, the delta encoder 140 is ready to encode a web object 132 for 

8 delivery to the client 1 1 0. 
9 

idO At a step 221, the object comparator 143 receives the web object 132 from the 

C3l 1 server 1 30, As noted above, the delta encoder 140, from time to time, requests template informa- 

ffi 

Ml tion 157 from the template server 153, and records that template information 157 in its memory 

M 

3 or mass storage. 

fU 

r||5 At a step 222, the object comparator 143 compares the web object 132 with the 

3 y 

Q 6 template information 1 57, and generates delta information 1 56. 
17 

18 At a step 223, the delta fonnatter 144 formats the delta information 1 56 for deliv- 

19 ery to the client 1 10, generates a response message 133 and sends that response message 133 to 

20 the network 1 20 for delivery to the client 1 1 0. hi one embodiment, the delta fonnatter 144 com- 

21 presses the delta information 156 before packaging that information in the response message 

22 1 33. 
23 
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1 The delta encoder 1 40 returns to the flow point 220. 
2 

3 Template Builder 
4 

5 At a flow point 230, the template builder 1 50 is ready to build template informa- 

6 tion 1 57. This is done the first time a web object 1 32 is requested and whenever the delta infor- 

7 mation 1 56 associated with that web object 1 32 grows "too large". 
8 

9 At a step 231, the object requestor 151 requests one of the web objects 132 fiom 

!]^10 the server 130. 

I3 

'J 12 At a step 232, tihe template builder 150 receives the one web object 132 and re- 

iy 13 cords it in its memory or mass storage. 

C3i4 

ru 

fU 15 At a step 233, the template identifier 152 compares the one web object 132 with 

fU 

•3 16 an earlier version of that web object 132, and generates template information 157 in response to 

m 

17 flie comparison. 
18 

19 At an optional step 234, the template identifier 152 compresses the template in- 

20 formation 157. 
21 

22 The template builder 1 50 returns to the flow point 230. 

23 
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1 The template server 1 53 operates in like manner as an ordinary web server, except 

2 that it provides template information 1 57 instead of web objects 1 32. 
3 

4 Alternative Embodiments 
5 

6 Although preferred embodiments are disclosed herein, many variations are possi- 

7 ble which remain within the concept, scope, and spirit of the invention. These variations would 

8 become clear to those skilled in the art after perusal of this application. 
9 

10 • The invention is generally applicable to client-server processes, and to systems in which 

1 1 clients request information and servers provide information in request to responses, such 
■ ^ 12 as for example client-server database systems and chent-server file systems. 

p 14 Those skilled in the art will recognize, after perusal of this application, that these 

fU 



15 ahemative embodiments are illustrative and in no way limiting. 
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